# Localized deployment

Quantized version of Qwen3-8B, quantized using the imatrix option of llama.cpp, suitable for text generation tasks.

An image-text to text conversion model built on the Meta Llama base model, supporting interaction through gguf-connector and llama-cpp-python.

Mistral Small 3.1 is a large multimodal language model with 24 billion parameters, possessing visual understanding ability and 128k long context processing ability, suitable for various tasks.

This model is converted from google/gemma-3-12b-it to GGUF format, suitable for the llama.cpp framework.

The GGUF quantized version of the Gemma 3 1B model, suitable for text generation tasks.

The GGUF format version of Llama-3.2-1B-Instruct, providing broader support and better performance.

The GGUF format file of the Qwen2.5-1.5B-Instruct model, suitable for text generation tasks.

This is the GGUF quantized version of the Polish large language model Bielik-11B-v2.3-Instruct developed by SpeakLeash, suitable for local deployment and use.

This model was converted from microsoft/Phi-3-mini-4k-instruct to GGUF format using llama.cpp via ggml.ai's GGUF-my-repo space.

Meta-Llama-3.1-405B-Instruct is a large language model with 405 billion parameters based on the Llama 3.1 architecture, optimized for instruction-following tasks and supporting multiple languages.

The GGUF quantized version of the Gemma-2b-it model, suitable for local inference and supporting text generation tasks.

Breeze-7B-Instruct is a Traditional Chinese optimized language model based on Mistral-7B, specifically designed for instruction-following tasks, supporting scenarios such as Q&A and multi-turn dialogues.

ChatMusician-GGUF is a text generation model based on the GGUF format, suitable for music - related text generation tasks.

InsTagger is a tool for automatically providing instruction tags. It achieves its function by extracting tag results from InsTag and is mainly used to analyze large language model supervised fine-tuning data consistent with human preferences.